Managing stochastic algorithms CV variability using an interval valued multiple comparison procedure
نویسندگان
چکیده
The usual procedure to compare metaheuristics or evolutionary algorithms using cross validation is repeating the training stage several times for each train/test pair. In general, the results of the different repetitions are not independent and this practice is questionable. In this work, it is suggested to represent the results of each train/test set pair by an interval or by a fuzzy set and use the proper statistical tests to these kind of data. In this way, the paired comparison of these sets leads to an interval valued p-value or to a fuzzy p-value that holds information about the mean differences but also about the differences in dispersion between the compared algorithms. Keywords-Experimental design; cross validation; stochastic algorithms; fuzzy statistics
منابع مشابه
Multiple Fuzzy Regression Model for Fuzzy Input-Output Data
A novel approach to the problem of regression modeling for fuzzy input-output data is introduced.In order to estimate the parameters of the model, a distance on the space of interval-valued quantities is employed.By minimizing the sum of squared errors, a class of regression models is derived based on the interval-valued data obtained from the $alpha$-level sets of fuzzy input-output data.Then,...
متن کاملA Suggested Approach for Stochastic Interval-Valued Linear Fractional Programming problem
In this paper, we considered a Stochastic Interval-Valued Linear Fractional Programming problem(SIVLFP). In this problem, the coefficients and scalars in the objective function are fractional-interval, and technological coefficients and the quantities on the right side of the constraints were random variables with the specific distribution. Here we changed a Stochastic Interval-Valued Fractiona...
متن کاملInterval-valued intuitionistic fuzzy aggregation methodology for decision making with a prioritization of criteria
Interval-valued intuitionistic fuzzy sets (IVIFSs), a generalization of fuzzy sets, is characterized by an interval-valued membership function, an interval-valued non-membership function.The objective of this paper is to deal with criteria aggregation problems using IVIFSs where there exists a prioritization relationship over the criteria.Based on the ${L}$ukasiewicz triangular norm, we first p...
متن کاملUniversal Approximation of Interval-valued Fuzzy Systems Based on Interval-valued Implications
It is firstly proved that the multi-input-single-output (MISO) fuzzy systems based on interval-valued $R$- and $S$-implications can approximate any continuous function defined on a compact set to arbitrary accuracy. A formula to compute the lower upper bounds on the number of interval-valued fuzzy sets needed to achieve a pre-specified approximation accuracy for an arbitrary multivariate con...
متن کاملSoft Computing-based New Interval-valued Pythagorean Triangular Fuzzy Multi-criteria Group Assessment Method without Aggregation: Application to a Transport Projects Appraisal
In this paper, an interval-valued Pythagorean triangular fuzzy number (IVPTFN) as a useful tool to handle decision-making problems with vague quantities is defined. Then, their operational laws are developed. By introducing a novel method of making a decision on the concept of possibility theory, a multi-attribute group decision-making (MAGDM) problem is considered, in which the attribute value...
متن کامل